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DIGITAL IMAGE INTERPOLATOR 

Cross-Re ference to Related Application 
Reference is hereby made to U.S. Patent 
5 Application No. 367,177 entitled "Digital Image 

Interpolator with Undersamples Interpolation 
Kernel" by R * Kogstad, and Application No. 368,458 
entitled "Digital Image Interpolator with Multiple 
Interpolation Algorithm by L. VanNostrand, both 
10 filed on even data herewith. 

Technical Fielfl 

The present invention relates to 
interpolators for processing digital images, and more 
15 particularly to such interpolators for high speed 

processing of digital .images, such as diagnostic x-ray; . ; 
images to magnify or reduce such images. 

20 U.S. Patent No. 4,595,958 issued <June 17, 

1986 to Anderson Jr. et al. discloses a process of 
recording one or more digital images on a. hardcopy 
output medium such as photographic film or paper. In 
the process of recording the digital images, they may 

25 be enlarged or reduced by interpolation to fill the 
available output medium. Although one interpolation 
algorithm is disclosed (i.e. linear interpolation) no ^ ; 
specific hardware for performing the interpolation . is 
described. 

30 U.S. "Patent -No. 4,578,812 issued March 25,. 

1986 to Yui discloses hardware for performing high 
speed two-rdimensional interpolation on a digitaT image v ; 
by the method of cubic convolution. In the 
two-dimensional cubic convolution interpolation 

35 algorithm implemented by the hardware, sixteen pixels 
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f rom the original image surrounding an interpolation 
site, in a two-dimensional array are simultaneously- 
multiplied by 16 corresponding interpolation 
coefficients (weight factors) and the 16 products are 
5 added to produce the interpolated value at the 

interpolation site. The interpolation coefficients 
represent samples of a two-dimensional cubic 
convolution interpolation kernel, and are stored in a 
digital memory. The cubic convolution kernel is 

10 sampled at a granularity of 32 x 32 samples between 
original pixels. The samples are stored as 12-bit 
values. As a result, the total storage requirements 
for the interpolation coefficients is 32 x 32 x 12 x 
16 = 19 6 r 608 bits, where the "16* indicates the 16 

15 coefficients applied to the 16 pixel values to obtain 
the interpolated value. The storage requirement is 
thus about 192K bits for the interpolation 
coefficients. 

For high resolution images, such as 

20 diagnostic x-ray images, it is desirable to sample the 
cubic convolution kernel at a much finer granularity, 
say 256 x 256, and to record the coefficients to a 
higher accuracy, say 16 bits, to provide a more 
accurate interpolation, and finer divisions between 

25 magnification choices. This would require 256 x 256 x 
16 x 16 which approximately equals 16 M bits of read 
only memory for storing the interpolation 
coefficients. The provision of such a large amount of 
read only memory would be very costly and difficult to 

30 address. 

Furthermore, it is known that for certain 
types of images cubic convolution does not produce an 
optimum interpolated image and other interpolation 
algorithms such as linear or replication are 
35 preferred. It is therefore the object of the present 
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invention to provide apparatus for performing cubic 
convolution interpolation on a digital image that 
overcomes the shortcoming noted abovie. It is a 
further object of the invention to provide 
5 interpolation apparatus that can also be employed to 
perform other types of interpolation such as linear 
and replication. 

Disclos ure of the Invention 

10 The object is achieved according to the 

present invention by providing a digital image 
processor for performing two-dimensional 
interpolation, having an interpolation coefficient 
memory containing interpolation coefficients 

15 representing a one-dimensional interpolation kernel, 
A row interpolator connected to the memory receives 
image pixel values along a row, retrieves . ; 
interpolation coefficients, from the memory, and 
produces interpolated pixel values by interpolating in 

20 the row direction. A column interpolator connected to 
the memory and to the row interpolator receives rows 
of interpolated pixel values from the row 
interpolator , retrieves . interpolation coefficients 
from the coefficient memory, and produces rows of 

25 intepolated pixel values by interpolating in a column 
direction. In a preferred embodiment of the 
invention, the interpolation coefficient memory 
contains a plurality of . interpolation kernels for 
performing different types of interpolation such as 

30 cubic convolution, linear, and replication, and the 
interpolator includes a logic and control -unit for. 
selecting one of the interpolation kernels in response 
to an operator input. According to a further feature * 
of the invention, the interpolation coefficients are 

35 stored in a plurality of banks in the memory > and the 
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banks are simultaneously addressed to return a 
plurality of coefficients, one coefficient from each 
bank. According to a further aspecft of the invention, 
the row interpolator includes control means for 
5 replicating the first and last pixel in a row in an 
image so that interpolation values can be computed 
between the first and second pixels of an image row, 
and between the last and next to last pixels of a 
row. Similarly, the column interpolator includes 
10 control means for replicating the first and last rows 
of an image for interpolating between the first and 
second rows, and between the last and next to last 
rows of an image. 

15 Brief Description of the Drawings 

Fig. 1 is a block diagram of an interpolator 
according to the invention; 

Fig. 2 is a graph showing a cubic convolution 
interpolation kernel; 
20 Fig* 3 is a graph useful in describing the 

method of interpolation by cubic convolution; 

Fig, 4 is a schematic block diagram showing 
the arrangement of the interpolation coefficient 
memory; 

25 Fig. 5 is a graph illustrating a linear 

interpolation kernel; 

Fig, 6 is a graph illustrating replication 
interpolation kernel; 

Fig. 7 is a diagram illustrating the layout 
30 of one example of an output image; 

Fig. 8 is a flow chart illustrating the 
overall control of the interpolator shown in Fig. 1; 

Fig. 9 is a block diagram showing the row 
interpolator in further detail; 
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Fig, 10 is a block diagram showing the row 
ALU in further detail; 

Fig. 11 is a flow chart shewing the operation 
of the row controller; 
5 Fig* 12 is a flow chart showing the 

initialization function performed by the row 
controller; 

Fig. 13 is a flow chart showing the "get new 
pixel":., function performed by the row controller; 
10 Fig, 14 is a block diagram. showing the 

horizontal displacement calculator in the row 
controller; 

Fig. 15 is a block diagram showing the column \\: 
interpolator; 

15 Fig, 16 is a block diagram showing the column / 

ALU; *••"'•'.;• ? ;: 

Fig, 17 is a block diagram showing the 
organization of the line stores in the column 
interpolator; 

20 Fig. 18 is a table useful in describing the 

operation of the read/write select module associated 

with the line stores shown in Fig, 17; 

Fig. 19 is a. flow chart showing the "operation".. ; . 

of the column, controller; 
25 . Fig. 20 is a flow chart showing the 

initialization function performed by the column 

controller; 

Fig. 21 is a block diagram showing the 

vertical displacement calculator portion of the coiumb. 
30 controller. 

Modes of Carrying ..Qixt^faft Xpventjjpn 

Fig. 1 is a schematic block, diagram showing ** •/ : 
an interpolator, according to the present invention. • . 
35 The interpolator receives digital image pixel data/ 
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for example from a frame store memory <not shown), one 
row at a time, and produces interpolated digital image 
data one row at a time which can be^feupplied to a 
printer (not shown) or stored for future use for 
5 example in a frame store* The interpolator includes a 
logic and control unit 10 which calculates a 
horizontal sampling increment h ff and a vertical 
sampling increment h v for the output images and 
controls the overall operation of the interpolator . 

10 The sampling increment h is determined by 

magnification factors that can represent expansion, 
reduction, or no change in the number of pixels in the 
image in the horizontal and vertical directions. The 
interpolator includes a row interpolator 12, a column 

15 interpolator 14, an interpolation kernel lookup table 
16, and an output buffer 18. In operation, the logic 
and control unit 10 receives instructions regarding 
the number and size of input images to be printed on a 
particular output format, and calculates magnification 

20 factors to be applied to each image, based on the 

number of pixels in the original image, and the number 
of pixels to be provided in the interpolated output 
image. The row interpolator 12 retrieves pixel values 
along a row and interpolates pixel values P' between 

25 them by retrieving interpolation coefficients from the 
one— dimensional interpolation kernel lookup table 16. 
The row interpolator multiplies the pixel values by 
their respective interpolation coefficients and suras 
the product to produce the interpolated values. The 

30 interpolated pixel values P' from the row interpolator 
are supplied upon request to the column interpolator 
14 on line 20. The column interpolator 14 reguests 
data on line 22 and when the row interpolator 12 
supplies the data, an acknowledgment is supplied on 

35 line 24. 
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The column interpolator 14 acquires arid 
stores several rows of interpolated pixel data until 
it can. start performing interpolation in a column 
direction on the stored data. When sufficient data 
5 has been acquired, the column interpolator 14 begins 
interpolating in a column direction to_ produce rows of 
interpolated values P M between the rows supplied by 
the row interpolator 12. 

The column interpolator 14 interpolates, in a 

10 column. direction by selecting a plurality of pixel 
values arranged in a. column from the acquired rows ; 
retrieving a corresponding plurality of interpolattiori 
coefficients from the lookup table 16/ and perforTning 
multiplication and addition of the products in a 

15 manner similar to the row interpolator 12. The column 
interpolator 14 provides rows of interpolated pixel- 
values P" to the output buffer 18, which is double 
buffered so that a row of interpolated pixel values •: 
can be read out while the next row is being, read into 

20 the output buffer 18. Double buffering Is prpauced"ds 
is known in the art by a pair of buffers 26 and 2*8. and 
multiplex switches 30 and 32. . : 

One-dimensional interpolation by use of the 
coefficients stored in lookup table 16 will now : be . 

25 described. Interpolation can be described as:' 



30 where P'(x) represents the interpolated value/ 
/ x " x k\ 

C I -5-- ) is a value of the interpolation kernel at 

location (x-x^) ; h is the sample increment of . the 
35 interpolated function, x^ represents the . location of 
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the samples of input data (also called interpolation 
nodes) and are the values of the input data at 
the interpolation nodes. 

The interpolation kernel is a continuous 
5 function that converts . sampled data into a continuous 
function, the resulting continuous function can then 
be resampled to obtain the interpolated sample 
values. Cubic convolution employs a kernel that is 
defined by piecewise cubic polynomials defined on the 

10 subintervals (-2,-1), (-1,0), (0,1), and (1,2). 
Outside the interval (-2,2) the kernel is zero. 
Evaluation of equation 1 for the cubic convolution 
kernel requires . four consecutive data samples from the 
original image data. Fig. 2 is a graph showing the 

15 cubic convolution kernel 34 defined on the interval 
(-2,2). The scale of the X axis in Fig. 2 is 
equivalent to the spacing of the data samples in the 
original image. 

Fig. 3 illustrates how the interpolation 

20 kernel 34 is employed to compute an interpolated value 
at location x. Four consecutive data values from the 
original image data are shown as A, B, C, and D. To 
produce an interpolated value at location x, the 
interpolation kernel 34 is centered at x, and the 

25 values of the kernel are calculated at the locations 
of the original data samples. These values C A , 
Cg, C c , and C D are the interpolation 
coefficients. The interpolated value at x is: 



30P'(x) = 




A value at any location between original 



sample points B and C can be computed in this manner. 
To avoid the necessity of calculating the values of 
the interpolation coefficients each time an 

35 

interpolated value is produced, the coefficient values 



-9- 

are calculated from the piecewise cubic polynomials 
defining the kernel, and stored in the lookup table 16 
(see Fig. 1). In a preferred mode* of practicing the 
invention, the kernel is evaluated at 1,024 points to 
16-bit accuracy. The resulting 1,024 coefficients axe 
divided into four groups, representing the four 
segments of the kernel between (-2,-1), (-1,0), (0,1), 
and (1,2), each group having 256 coefficients. The 
four groups are. stored in four banks of memory which . 
can be simultaneously addressed by a displacement 
value. d that represents the distance from the zero in 
the kernel -1 to the sample B . The arrangement of the 
interpolation kernel lookup tables is shown in Fig. 4, 
where the first memory bank 36 contains the 256 
coefficients that define the kernel on the interval , 
(-2,-1), which is shown graphically in the Figure. 
Similarly the second memory bank 38 contains the group 
of coefficients representing the portion of the 
convolution kernel from (-1,0), and so on for memory 
banks 40 and 42. As shown in Fig. 4, a displacement 
value d is simultaneously applied to all four memory 
banks to produce coefficients C 1 , C 2 , C. 3 , and 
C' 4 . Returning now to Fig . 1, the interpoliation 
kernel lookup table may contain kernels for any number 
of other types of interpolation such as linear and 
replication, in addition to different, types of cubic 
convolution. In the preferred embodiment of the 
invention, the. lookup table 16 contains two cubic 
convolution kernels, one with a - -1 (44) and one with 
a = -.5 (46), where a is a constraint applied to the 
interpolation kernel polynomials when the kernel is 
defined as follows: 

( (a+2) |S| 3 -(a+3) 2 + l 0ZjS|<| . 
C (s) - Ja|S| 3 -5a|S|: 2 +8a|s|-4a |<|S|<2 (2) 

( 0 2<|s|,\ . 
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- The interpolation lookup table also contains 
a kernel for linear interpolation (48) and a kernel 
for replication (50) . The kernel f^r linear 
interpolation is shown in Fig, 5, and is graphically 
5 represented as a triangular waveform in the interval 
(-1,1) and zero elsewhere. The kernel for replication 
is shown in Fig. 6 and is graphically represented as a 
step function having a value of one in the interval 
(-2 /-I) and zero elsewhere. Returning to Fig. 1, the 

10 logic and control circuit 10 selects the lookup table 
addressed by the interpolators 12 and 14 in response 
to an operator input specifying the interpolation 
procedure that is desired. For example, it is known 
that replication interpolation performs better on 

15 binary images such as text, thus the nearest neighbor 
kernel may be selected for performing interpolation on 
text portions of an image. 

The sampling increment h is determined by the 
logic and control unit 10 by first determining a 

20 magnification, factor M defined as the lesser of the 
two ratios x'/x, y'/y, where x is the number of pixels 
in the original image in the horizontal direction, and 
x T is the number of pixels available on the output 
printer for printing the original image. The number 

25 0 f available pixels on the output medium is determined 
by the output format including the width of the output 
medium and the number of input images to be printed 
across the page in the output image. Similarly, y 
represents the number of pixels in an input image in 

30 the vertical direction and y r represents the number of 
pixels available to print the image in the vertical 
direction. The lesser of the two ratios is chosen so 
that the reproduced image will not be cropped. The 
sampling increment h is then determined by: 

35 
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h « (4) ^ 

where the 256 in the numerator coms^.. from the fact 
that the interpolation kernel has been sampled 256 
5 times between each interpolation node. The sampling 
increment h is computed to an accuracy of 24 bits.. 
Values of h between zero and 256 represent 
magnification, and values between 256 and 4095 
represent reduction. 

^ In a preferred embodiment, the output image 

format is selectable by the user, and comprises one or 
more bands. There are two types of bands, image arid, 
text. Each text band is specified by the height of 
the band in pixels and the number of character images 

15 in the band, and each image band is specified by the 
height of the band in pixels, and the number of . images 
in the band. Minimum borders and separation, between ; 
the images horizontally and vertically are determined 
automatically by the LCU 10. An example of an output 

2 Q format is shown in Fig. 7. The output image 52 
includes a first band 54 y x pixels high, having 3 
images 56, 58, and 60, a second band 62, y 2 pikels 
high having 2 images 64 and 66, and three text b^nds 
68, 70, and 72, each y 3 pixels high. 

25 The overall control provided by the logic arid 

control unit is shown in Fig. 8. The LCU 10 first 
performs a setup (74) calculating the horizontal and 
vertical sampling increments h H , 1^ as described 
above. It is possible that the sampling, increments 

3 q are not identical due to the fact that the. individual 
pixels may not have the same horizontal and vertical 
dimensions. The LCU sends the band parameters for the 
first band, including the horizontal and vertical 
sampling increments h H and hy, number of lines "in . 

35 the band, number of images in the band, and number of 
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input and output pixels per image to the row and 
column interpolators. Next, the LCU signals the row 
and column interpolators 12 and 14 start 
interpolating (76). When an end of band signal is 
5 received (78) from the column interpolator 14, the LCU 
checks to see if the last hand in the image has been 
interpolated (80) . If not, a setup is performed for 
the next band by returning to function 74 and the 
process is repeated. If the last band is completed, 

10 the process is ended. The band parameters are double 
buffered so that the interpolation can employ one set 
of parameters while the next set is being loaded. 

The row interpolator 12 will now be described 
in more detail with reference to Fig. 9. The row' 

15 interpolator 12 includes a row controller 82 and a row 
arithmetic and logic unit (ALU) 84. The row 
controller receives the band parameters from the LCU 
10 and controls the row ALU 84. The row controller 82 
includes a displacement calculator 85 that generates a 

20 displacement address d R that is an increasing 
multiple of the sampling increment h„ across an 
xnput image, and sends the displacement address d R 
to the interpolation kernel lookup table 16. The row 
controller retrieves original image pixels values from 

25 the frame store and orders the row ALU 84 to perform 
interpolation calculations to produce interpolated 
pixel values P' and supplies the interpolated pixel 
values P' to the column interpolator in response to 
data request. The row ALU 84 receives the original 

30 values P from the frame store and the interpolation 
coefficients C R from the lookup table 16 and in 
response to a command to start from the row controller 
82, calculates the interpolated values P*. 

The row ALU 84, which is shown in more detail 

35 i n pig. 10 i nc i udes an input register 86 that receives 
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and temporarily holds pixel values from the frame 
store. The pixel values are transferred in parallel 
from input register 86 to a working^register 88, from 
which they can be shifted sequentially to a multiply/ 
5 accumulate module 90. The four interpolation 
coefficients C 1 «C 4 from the lookup table 16 are 
entered in parallel into a coefficient register 92 
from which they are shifted in sequence to the 
multiply/accumulate module 90, A row multiplier . 

10 controller 94 is slaved to the row controller 82 , and' 
upon receipt of a start multiply signal from the row 
controller 82 , signals the raultiply/accumulater. module 
90 to perform the multiply and accumulate operations * 
oh the data in registers 88 and 92 to compute .an 

15 interpolated pixel value P r as follows: 

P ' « ( C 1 xP 1 ) + ( C 2 xP 2 ) + ( C 3 xP 3 ) + ( C 4 xP 4 ) . (5) 

The operation; of the row controller is shown 
in Fig. 11. On. command from the LCU 10, the row 
controller loads the band parameters (96) including ■:>> 

20 the number of lines in the output band/ the horizontal ;. 
sampling increment h^, the number of images in . the 
band, and, the number of horizontal pixels in. the 
images. Next, the row controller initializes (98) the 
row ALU 86 by sending pixel addresses; to thet f rame 

25 store memory. The pixels are sent from the frame 

store to the input register 86 in the row ALU 84 . The 
initialization step 98 is shown in Fig. 12. -To 
provide : .the interpolator with sufficient ihfomiatibn 
so that interpolation can . be performed between • the . 

30 first two pixels in a row, the first pixel P.^ in the 
row is loaded twice (100) as shown in register 88 in 
Fig. 10. The next two pixels in the row p and . 
P 3# - are retrieved (102) from the frame store and 
loaded in the input register 86 of the ALU 84 . 

35 Finally, the -row controller ; 82 sends a register, clock 
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signal (104) to transfer the pixel data from the input 
register 86 to the working register 88 in the row ALU. 

Returning to Fig. 11/ the fow controller 
checks to see if a new pixel is required (106)* If a 
5 new pixel is required, the row controller gets a new 
pixel (108) from the frame store as shown in Fig* 13* 
First a check is made (110) to determine if the end of 
a row in an image has been reached. If not, the next 
pixel in the row is fetched (112) from the frame 

10 store- If the end of the row in the image has been 
reached, in order to provide data for the 
interpolator, the last pixel in the row is replicated 
(114), The step of replicating the last pixel in the 
row can occur twice in succession until the 

15 interpolation kernel is centered on the last pixel in 
the row. Then the pixel data in input register 86 is 
transferred to working register 88 (116) . 

Returning to Fig. 11, when a new pixel is no 
longer required, the four interpolation coefficients 

20 C 1" C 4 are ordered from the lookup table 16, by 

sending a displacement address d^ to the coefficient 
lookup table 16 (118) . The interpolation coefficients 
C^— are loaded into the coefficient register 92 
in the ALU 84 and the row controller 82 signals the 

25 row multiplier controller 94 to calculate an 

interpolated value P' by sending a start multiply 
signal. When the multiply accumulate operation is 
completed, a multiplication done signal is returned 
from the row multiplier controller 94. Next, the row 

30 controller checks for the end of an image (122). This 
is a check for the end of a line in an image and not 
for the last line in the image. 

If the end of the image has not occurred, the 
row controller returns to see if a new pixel is 

35 required (106). If it is the end of the image, a 
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check is made (124) to see if it is the end of a line 
(i.e. the end of a row in the last image of the 
band). If not, the row controller Returns: to 
initialize (98) for the next image in the band. If it 
5 is the end of the band, a check is made (126) to-see * 
if the end of the band has been encountered. If not, 
the row controller returns to initialize (98) for the 
next line in the first image in the band. If the end 
of the -band is encountered/ a check is made. to see if^ 

10 it is the end of the page (128). If not, the row 
controller switches to the band parameters (96) for 
the next band. If it is the end of the page, the 
interpolation is finished for that page. 

The displacement calculator 85 that 

15 calculates the displacement value d H for addressing, 
the lookup table 16, and determines when to get 
another pixel from the frame store will now be 
described with reference to Fig. 14. 

At the beginning of a band, the value* of the 

20 horizontal sampling increment h R is latched into a 
24 bit data 1-atch 130, and at the start of each line 
of each image, an initial value of 4, stored in a 
latch 132 is selected by a selector 134. The initial . ; 
value and the value of from register .130 are 

25 summed in a summer 136. The sum is stored in a "next 
register" 138, the contents of which are supplied to . 
the input of the summer 136 on the next. and succeeding 
cycles of the displacement calculator . Bitg 8-15 of . 
the sum are extracted 140, and represent the 

30 displacement value d^ employed to address *he lookup 
table 16 to retrieve the interpolation coefficients. 
It is desirable to provide a nearly continuous 
magnification factor so that images of any size can be . 
interpolated to images of any other size. This could 

35 be accomplished by sampling the interpolation kernel '. 
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at very fine increments* However, this would require 
a large memory for holding the sampled interpolation 
coefficients* Past a certain point*/ increasing the 
sampling resolution of the interpolation kernel does 
5 not significantly improve the accuracy of the 
interpolation. Therefore, to provide a nearly 
continuous range of magnifications, while avoiding a 
prohibitively large coefficient table, the 
displacement h R is calculated to a higher precision 

10 than the interpolation kernel is sampled* In the 
preferred embodiment the displacement h^ is 
calculated to 16 bit fractional accuracy <e*g« eight 
bits for the integer portion employed for reduction, 
and 16 bits for the fractional portion = 24 bits) and 

15 the kernel is sampled to 8 bit accuracy (e.g* 256 

samples between interpolation nodes). The address for 
the interpolation coefficient memory is generated by 
taking bits 8-15 of the sum accumulated in summer 
136* This has the effect of selecting the values of 

20 the interpolation kernel at the nearest preceeding 

sampling location. The resulting interpolation errors 
are not visible in the output image. The most 
significant 16 bits of the sum is compared in a 
comparator 142 with a cumulative count from a counter 

25 144 that is initialized to zero at the start of a row 
in an image, and is incremented each time a pixel is 
received from the frame store. As noted previously, 
the first pixel in a row in an input image is 
duplicated to provide data for interpolating between 

30 the first and second pixels, and the last pixel is 
duplicated twice when the end of the row is reached* 

The row controller is requested to get a new 
pixel until the value n at the comparator 142 is equal 
to m. Thereafter, each time that n becomes greater 

35 than m, a new pixel is ordered. The displacement 
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value is a raonotonically increasing multiple of 
h„ f s that increments each time a new interpolated 
value PI is calculated, and is set T:o zero at the 
start of each row of each image. 
5 . The column interpolator 14 will now be 

described in further detail with reference to. Fig. 
15. The column interpolator includes five line stores 
146 for receiving interpolated row data P' from the 
row interpolator, and supplying the row interpolated 

10 data to a column ALU 148. The column ALU 148 receives 
the interpolated data values from the line store 146/. 
and interpolation coefficients C k from the lookup 
table 16 and performs multiply and accumulate 
operations similar to those performed by the row ALU" 

15 84 described previously, to produce a new interpolated 
value P M between rows. The values P" produced by the 
column ALU 148 are sent to the output buffer 18 (see 
Fig. 1). The loading of data into the line stores 146 
from the row interpolator, and supplying data from 

20 them to the column ALU 148 is controlled by a line \ 
store controller 150. . Overall control of the column 
interpolator 14 is provided, by a column controller 
152. The column controller i52 requests interpolated . 
data from the row interpolator and includes a column 

25 displacement calculator 154 for calculating the 

vertical displacement values d v that are employed to .; ^ 
address the look up table 16. The column controller : 
152 also signals the column ALU 148 when to start 1 , 
computing an interpolated value. 

30 The structure of the column ALU 148 is. shown 

in more detail in Fig. 16. The column ALU 148 
receives interpolated row data directly f rtfm the line 
stores 146. Each four successive interpolated samples 
are from corresponding row locations in four 

35 succeeding rows of an image. A coefficient register 
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158 receives four corresponding interpolation 
coefficients C^-C^ from the lookup table 16. A 
multiply and accumulate module 160 receives the 
interpolated pixel values P* and coefficients C fe and 
5 performs multiplication and summation to produce the 
interpolated values P" that are supplied to the output 
buffer 18, The computation of the interpolated value 
P" is defined by: 

-P--<P' 1 , 1 .C 1 ) + <P' 1#a .C 2 )+(P' 1# 3.C 3 ) + (P' 1/4 .C 4 ) 

10 where P" is the interpolated pixel value between rows 

of interpolated pixels, P'^^ is the i^* 1 pixel 

th ^ 

value from the j row of interpolated values, and 
C fc are the interpolation coefficients. A column 
multiply controller 162 is slaved to the column 

15 controller 154, and upon receipt of a start signal 
from the column controller 154 causes the column 
multiply and accumulate module 160 to perform the 
computation of the interpolated value P w . When the 
computation is complete, the column controller 162 

20 returns a "done** message to the column controller 152 • 
Control of the line stores 146 will now be 
described in further detail with reference to Figs. 17 
and 18. Interpolated data P* from the row 
interpolator is directed to any one of the five line 

25 stores 146, numbered 0 through 4, by applying a write 
signal to the line store while data is applied to the 
inputs of all the line stores simultaneously. Each of 
the line stores is a first-in first-out line memory 
that is capable of storing up to 4096 interpolated 

30 values of 17 bits each. The outputs from the line 

stores are selected one at a time by tri-state buffers 
176 and supplied to the column ALU 148. 

The tri-state buffers 176 are controlled by a 
read/write select module 178 that applies the outputs 

35 of the line stores (numbered 0-4 in Fig. 17) to output 
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the line according to the selection table shown in 
Fig. 18. Read and write signals are also applied to 
the line stores by the read/write select module 
according to the selection table shown in Fig. 18. 
5 Thus, while data is being written into line:store 4, 
data is being serially read out of line stores 0, 1-/.. 
2, and 3. When a signal is received from the line 
store controller 150 to access the next line, the 
read/write select module 178 advances to the next row 

10 in the table shown in Fig. 18, and controls the line 
stores accordingly. 

The operation of the column controller 152 is 
shown in Fig. 19. First the column controller loads . 
the band parameters (180) from the LCU 10, including. 

15. the vertical output sampling increment hy, the /\- e 
number of lines per band, the number of images per 
band, and the number of lines in the original image. 
Next, the column controller initializes (182) the data 
in the line stores by ordering the row interpolator 12 

20 to perform row interpolation until 3 rows of 

interpolated data are read into line stores 0,. 1, and 
2. Similar to the initializing procedure performed 
for the row interpolator 12, the column interpolator 
duplicates the first row of data in ah image so 'that 

25 rows of interpolated data between the first and second 
rows may be obtained. To accomplish this,, the 
read/write select 178 addresses the tri-state buffers 
176 for line 0 twice for each pixel in. the first row 
of data. After the line stores are initialized (182). 

30 a check is made (190) to see if a new row of 

interpolated data is required. If so, the next row iis 
accessed .(192) by applying a signal to the read/write 
select module 178 that causes it to advance 'to the. 
next configuration shown in Fig. 18, and. a new row df 

35 interpolated . data is ordered from the row interpolator. 
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12. At the end of a band, the column interpolator 14 
replicates the last line, up to 2 times as required to 
provide data to interpolate up to tffe last line of 
data" values. This is accomplished as shown in Fig. 
5 20. When the next row is accessed (192) a check is 
made 194 to see if this row being requested is the 
last one in the band* If not, the next row is 
requested normally (196) from the row interpolator 
12. If this is the last row in the band, the last row 

10 is replicated up to two times (198) to provide 
interpolation data. 

Returning to Fig. 19, if a new row of data is 
not required (190) the column controller computes the 
displacement address d v and sends the address to the 

15 lookup table 16 to return the interpolation 

coefficients C 1 -C 4 (200). The column interpolator 
then interpolates a row of data (202) by successively 
sending four column wise data values from the four 
consecutive lines to the column ALU 148, and 

20 requesting the column ALU to compute the interpolated 
value P M . At the end of the row, a check is made 
(204) to see if it is the end of the band. If not, 
control returns to see if a new row is required (190), 
and the cycle repeats. If it is the end of a band, a 

25 check is made 206 to see if it is the end of the 
page. If so, the page is not finished, control is 
returned to execute the next set of band parameters 
(180) for the next band. The band parameters are 
double buffered so that the interpolator can employ 

30 one set of parameters while the next set is being 
loaded. 

The column displacement calculator 154 which 
computes the displacement address for retrieving 
interpolation coefficients from lookup table 16, and 
35 determining when a new line of interpolated data is 
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required from the row interpolator 12, is shown in 
Fig. 21. The logic of the column displacement 
calculator 154 is identical to the logic of the row 
displacement calculator 85 described above. 
5 At the beginning of a band, the sampling 

increment is latched into a 24 bit data latch 
208, and an initial value of 4 stored in a latch 210 
is selected by selector 212. The initial value and 
the value of h v are summed by a summer 214. The sum 

10 is stored in a "next value" register 216, the contents 
of which are supplied to the summer 214 on the next 
and succeeding cycles to the end of the band.. Bits 
8-15 of the sum are extracted 218 and represent the. 
displacement address d v that is applied to the 

15 lookup table 16 to retrieve the four interpolation 
coefficients C^-C^. Tlie most significant 16 bits : '•. 
of the sum from summer 214 is applied to one input n 
of a comparator 220, and is compared with an 
accumulative count m from a counter 222 that is 

20 initialized to zero at the start of each band, and is 
incremented each time a new row of interpolated data 
is received from the row interpolator 12. A6 noted 
previously, the first row in a band is replicated to 
provide data for interpolating vertically between the 

25 first and second row of pixel data, arid the last row ; 
of interpolated pixel values is replicated up to 2 
times when the end of the band is reached. The column 
interpolator requests the row controller to supply a 
new row of pixel data until. the value at the n input 

30 of comparator 220 equals th<? value at input m from 
counter 222. Thereafter,, each time that n becomes 
greater than m, a new row of interpolated pixels is 
requested from the row interpolator. The displacement 
address d is a. running multiple of hy's that 

35 increment each time a new row of values is 
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interpolated, and is reset to zero at the beginning of 
each band. 

Industrial Applicability and Advantages 
5 The interpolator according to the present 

invention is useful for enlarging and reducing digital 
images such as diagnostic radiographs. The 
interpolator is advantageous in that a high resolution 
interpolation can be practically performed with a 

10 minimal size of coefficient memory. The invention has 
the further advantage that due to the reduced size of 
coefficient memory over the prior art two dimensional 
coefficient memory, several interpolation kernels may 
be stored in the memory, thereby providing the ability 

i5 to easily switch between different types of 
interpolation. 
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1. Digital image processing apparatus for 
performing two dimensional interpolation on a digital 
image expressed as rows and columns of pixel values, 

5 comprising : 

a. an interpolation coefficient memory 
containing a plurality of one dimensional 
interpolation kernels for performing a plurality of 
interpolation types including cubic convolution, 

10 linear, and replication interpolation; 

b. row interpolator means connected to 
said memory for receiving successive image pixel 
values along a row, retrieving interpolation 
coefficients from said memory, and producing 

15 interpolated pixel values by multiplying and summing 
the pixel values and interpolation coefficients; 

c« column interpolator means connected 
to said row interpolator means and said memory for 
receiving rows of interpolated pixel values from said 

20 row interpolator means, retrieving interpolation 

coefficients from said memory, and producing rows of 
interpolated pixel values by interpolating between 
groups of pixels in a column direction; and 

d* logic and control means for selecting 

25 one of said kernels in response to an operator input* 

2. the apparatus claimed in claim 1, 
wherein said interpolation coefficient memory is 
divided into a plurality of banks adapted to be 
addressed simultaneously to return a plurality of 

30 interpolation coefficients, one such coefficient from 
each of said banks. 

3. The apparatus claimed in claim 1, 
wherein said row interpolator means includes means for 
replicating the first and last pixel value in a row in 

35 an image, and said column interpolator means includes 



WO 90/16035 



PCT/US0O/Q3372 



-24- 

means for replicating the first and last rows of pixel 
values in an image. 

4. The apparatus claimed" in claim 1, 
wherein said row interpolator means further comprises 

5 row controller means for requesting pixel values from- 
a frame store memory and interpolation coefficient 
values from the coefficient memory, and row arithmetic 
and logic unit (ALU) means for receiving the pixel 
values and the coefficient values, and performing 
10 multiplication summation according to the formula 
P , »(P 1 xC 1 )+(P 2 xC 2 )+(P 3 xC 3 )+(P 4 xC 4 ) where P' is 
an interpolated value, P^^ are the pixel values and 
are the coefficient values. 

5. The apparatus claimed in claim 6, 

15 wherein said row ALU means comprises a four element 
input register for receiving said pixel values 
serially, a four element working register coupled to 
said input register for receiving said pixel values in 
parallel from said input register, a four element 

20 coefficient register for receiving interpolation 

coefficients in parallel from said coefficient memory, 
and multiply accumulation means coupled to said 
working register and said coefficient register for 
receiving said said pixel values and coefficient 

25 values in pairs, multiplying them, and accumulating 
the sum of their products. 

6. The apparatus claimed in claim 1, 
wherein said column interpolator means further 
comprises line store means for receiving rows of pixel 

30 values from said row interpolator, line store control 
means for controlling the addressing of said line 
stores, ALU means for retrieving pixel values from 
said line stores, and interpolating between the rows 
in a column direction, and column controller means for 

35 controlling the column interpolator means. 
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7. The apparatus claimed in claim 8/ 
wherein said column ALU means comprises a 4 element 
coefficient register for receiving; in parallel, four 
interpolation coefficients from the coefficient memory 

5 and delivering them serially, and column multiply and., 
accumulation means connected to said coefficient 
register and having inputs for receiving successive 
pixel values and coefficient values, and for 
performing a multiplication and summing the products 
10 to produce an interpolated pixel value according to 
the equation 

P "- (p, l,l- C l> + (P 'l,2' C 2> + < P 'l,3- C 3> + < P 'l,.4' C 4> 

where P M is the interpolated pixel value between rows 

of interpolated pixels, P'. . is the i th pixel 
15 value from the j row of interpolated values, and 
C^, are the interpolation coefficients. 

8. The apparatus claimed in claim 8, 
wherein said line store means comprises five first-in 
first-out line memories, multiplexing means for 

20 coupling the outputs of said memories in groups of 4 
to the ALU means, and read/write select means for 
controlling said multiplexing means and for 
controlling the data written into said line store 
means . 
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